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Summary 


This paper presents a globally convergent adaptive regulator 
for minimum or nonminimum phase systems subject to bounded 
disturbances and unmodeled dynamics. The control strategy is 
designed for a particular input-output representation obtained 
from the state space representation of the system. The leading 
coefficient of the new representation is the product of the 
observability and controllability matrices of the system. The 
controller scheme uses a Least Squares identification algorithm 
with a dead zone. The dead zone is chosen to obtain convergence 
properties on the estimates and on the ’covariance matrix* as 
well. This allows the definition of modified estimates which 
secure well-conditioned matrices in the adaptive control law. 
Explicit bounds on the plant output are given. 


Introduction 

Adaptive control techniques have been extensively studied for 
over a decade. The development of the theory has led to a better 
understanding and improvement of the performance of adaptive 
algorithms. Nevertheless, owing to the difficulties encountered 
when dealing with nonminimum phase systems, most of the treatment 
is confined to minimum phase systems. 

Discrete time minimum phase systems have the appealing 
property that boundedness of the output implies boundedness of the 
input. This property has been thoroughly exploited in the 
convergence analysis of adaptive schemes in which attention may be 
exclusively focused to obtain bounds on the plant output. A 
fortunate coincidence is that prediction error identification 
methods like Least Squares and projection algorithms are also 
focused on the plant output in the sense that they provide plant 
model estimates that adequately predict the plant output. These 
two facts allow one to compute a control sequence that produces an 
arbitrary desired output regardless of the controllability of the 
plant model estimate (refs. 1 through 10). 

Discrete time systems having nonminimum phase characteristics 
may appear in many different ways. For instance, all continuous 
systems having a relative degree greater than two give rise to 
nonminimum phase models when sampled at a fast rate with zero 
order hold input (ref. 11). In that paper it was also found that 
the pulse transfer function corresponding to l/s n has zeros on or 
outside the unit circle for na2. This indicates the restricted 
scope of application of those control laws for discrete time 
systems which involve cancellation of discrete zeros. It also 
underlines the importance of the study of adaptive control for 
nonminimum phase plants. 






Parameter estimation methods like Least Squares and 
projection algorithms are derived from an optimization problem 
formulation considering basically the output prediction error. It 
is not surprising that the plant model estimate obtained in such a 
way may not retain some important characteristics of the process 
like controllability, stability, delay, etc. .. Lack of 
controllability has been a stumbling block for the development of 
adaptive control of nonminimum phase systems. Unlike the minimum 
phase case, adaptive control for nonminimum phase plants require 
controllability of the plant estimate in order to assure that both 
plant output and input remain bounded. 

This problem has been addressed from two different 
perspectives: one relying on persistent excitation ( P. E. ) and 
the other not requiring P.E. . In the former an external signal 
having a minimum amplitude and a minimum number of spectral lines 
is introduced in the control loop. Such a signal will assure that 
a certain P.E. condition on the plant input and output will be 
satisfied. In the deterministic case, i.e. when there is no noise 
in the plant, P.E. on the plant signals will in turn assure 
convergence of the estimates to the true parameter values which 
will guarantee boundedness of all the signals in the control loop 
(refs. 12 through 15). This approach not only secures boundedness 
of all the signals but also exponential stability. 

However, in the presence of bounded disturbances or unmodeled 
dynamics the amplitude and frequency richness of the external 
signal should be large enough to secure P.E. of the plant input 
and output and prevent the noise in the closed loop from 
counteracting the external signal effect. Introducing an external 
signal of such a size into the plant may conflict with the control 
objective of having a small output tracking error. On the other 
hand, from the practical point of view, it is not always feasible 
or desirable to introduce extra noise into the system. For these 
reasons adaptive control not relying on persistency of excitation 
is an important alternative approach. Furthermore, adaptive 
stabilization without resorting to any P.E. condition will pave 
the way to a better understanding of the use of P.E. in the 
control loop. Indeed, if desired, a probing signal with a 
tolerable amount of P.E. could be introduced in the system to 
improve a given performance index, but not to guarantee stability. 

In the design of adaptive controllers whose stability does 
not rely on P.E. one is readily confronted with the problem of 
obtaining a controllable plant estimate. As pointed out above, 
minimization of performance indices on the output prediction error 
may not suit our control objectives. However, Least Squares type 
identification algorithms offer some freedom to modify the 
parameter estimates. As is well known, the " covariance matrix " 
acts as a memory and can be used to measure the parameter 
estimation error. It can also be used to define a modified 
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parameter estimate that will essentially preserve the convergence 
properties of the original parameter estimate. Such a modified 
estimate is obtained by adding ary linear combination of columns 
of the " covariance matrix " to the current estimate. The weights 
on the linear combination are arbitrary and cam be chosen to our 
advantage. This technique was used in the design of adaptive 
control schemes in the deterministic case in references 16 and 17 
wherein different modifications were proposed to the standard 
Least Squares identification algorithm. These modifications secure 
a nonsingular Sylvester resultant matrix obtained using the 
modified parameter estimates. The Sylvester resultant matrix 
appears in pole placement techniques and is nonsingular if and 
only if the associated system is controllable (ref. 18). Other 
modifications have been studied in reference 19 but the proposed 
algorithms are less explicit than those in references 16 and 17. 
Another interesting approach is presented in reference 19 where 
the problem is solved for the class of plants whose parameters 
belong to a convex region in the parameter space where the plant 
is pointwise stabilizable. Further studies are required to 
completely assess and characterize the plants belonging to that 
class. 

The modifications proposed to date in the literature have not 
been proved to secure a uniform, strictly positive lower bound for 
the singular values of the Sylvester matrix obtained using the 
modified estimates. Since the control input depends on the inverse 
of the Sylvester matrix, the size of that lower bound plays an 
important role in the assessment of the robustness capabilities of 
the adaptive control scheme. Clearly this problem is shared by any 
control law making use of the certainty equivalence principle. 

This paper presents a robust adaptive regulator for discrete 
time systems in the presence of bounded disturbances and unmodeled 
dynamics. The system is not restricted to be minimum phase and the 
class of unmodeled dynamics considered is the same as in 
reference 8 .The control objective is to achieve plaint output 
regulation. 

The control strategy has been devised for a particular 
input-output representation of the system. This representation is 
obtained from the state space representation of the plant and has 
the key feature that the matrix coefficient multiplying the 
sequence of inputs is the product of the system observability and 
controllability matrices. That product shall be refered to in the 
paper, as the leading coefficient. Therefore the leading 
coefficient caui be directly identified auid thus, the effect of any 
modification of the estimates on the controllability of the plant 
model estimate will appear more clearly . A Lea^t Squares 
identification algorithm with a particular dead zone is used. The 
width of the dead zone is such that convergence properties car be 
deduced, not only on the output prediction error but on the " 
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covariance matrix " as well. This leads to an explicit definition 
of a modified parameter estimate for which the singular values of 
the leading coefficient have a uniform, strictly positive lower 
bound. Explicit bounds for the plant output in the limit are also 
presented. 

The material that follows presents a discussion of a 
particular input-output representation of the system and a simple 
output feedback control law that achieves state regulation around 
the origin; the proposed control scheme and its obtained 
convergence properties. 


Symbols 

E prediction error vector 

F covariance matrix 

T 

L a matrix such that F = LL 

n order of the plant 

u(t) plant input 

x(t) state vector 

y(t) plant output 

w^_ augmented error 

5, normalized disturbance bound 

k 

£ controllability matrix 

0 observability matrix 

0 parameters vector 

0 modified parameters estimate 

0 parametric distance 

0q initial parameters estimate 

<f> measurement vector 

forgetting factor 


State Regulation via Output Feedback 

Consider the following state space representation of a 
single-input single-output discrete-time system 
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x(t+l) = Ax(t) + bu(t) + b*v’ (t) 


(l.a) 


y ( t ) = c T x(t) + v"(t) 


( 1. b) 


where x is the (nxl) state vector, u and y are the plant input and 
output, A, b, b’ and c are matrices and vectors of appropiate 
dimensions, and, v’ and v" are disturbances. 

The control strategy proposed in this paper is based on the 
input-output representation presented in the following Lemma. 


Lemma 1- The plant output and input in equation (1) satisfy the 
following input-output representation 


Y(t+2n) = GU(t+n) + BU(t) + DY(t) + B'U(t-n) + N(t+2n) (2) 


where 

U T (t) = [ u(t), ... u(t+n-l) ] (3. a) 

Y T (t+n) = [ y(t) y(t+n-l) ] (3.b) 

B = 0 t? (3. c) 

with 

; £ = [ A n_1 b Ab, b ] (3.d) 


0 = 


c 

c T A 


T.n-l 
C A 


D = 0 A 2n O' 1 


(3. e) 


B* = £) A" ? - 0 A 2 " 0 -1 G 


(3. f ) 


G = 


0 

T 

c b . 


T n-! 
A 


b 


T 

. .c b 0 


(3. g) 
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N(t+2n) = <Jg’T (t) + G’V’ (t+n) + V"(t+n)- 


- OA^O'^G’V’ (t-n) + V" (t-n) ] + OAVV’(t-n) (3.h) 

g’ and G’ are obtained by replacing b by b’ in the expressions for 
£ and G respectively. V’ and V" are defined the same way as U in 
equation (3. a). 


The proof is given in Appendix A. 


The input-output relationship in equation 2 is an alternative 
representation of the system (eqn. 1) that has some particular 
characteristics. If the system in equation 1 is reachable and 
observable then B in equation 3.c is nonsingular. On the other 
hand G in equation 3.g is always singular and for this reason we 
reserved the name leading coefficient for B and not for G. It can 
also be noted that Y(t+n) does not appear in equation 2 and this 
will allow definition of a very simple control law. 

Let denote U at time t = 2kn, k= 0,1,2, Assume 

U(t-n) = 0 for t = 2kn (4) 


Note that U(t+n) is also equal to zero for t = 2kn because 
U(2kn+n) = U(2(k+1 )n-n) . Then equation 2 can be written as 


Y k + 1 = DY k + 


BU k + 


N. 


k+1 


(5) 


Consider the control strategy defined by equation 4 and the 
following 


U k * - b'H 


( 6 ) 


Note that Y^ depends on output measurements up to time t = 2kn-l 

as can be seen from equation 3.b. Then the control input in 
equations 4 and 6 leads to 
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(7) 


k+1 


= N, 


k+1 


Since Y(t+2n) = N(t+2n) and U(t+n) = 0 for t = 2kn, x(t+n) is 
exclusively bounded by the disturbances N(t+2n), V’ (t+n) and 
V" (t+n) for time t = 2kn (eqn. A. 3). Since U(t+n) = 0, x(t+2n) 
will be bounded by x(t+n) and V’ (t+n) for t = 2kn ( eqn. A. 2). 

The proposed control strategy can also be interpreted as an 
alternated use of an n-step dead beat observer and an n-step dead 
beat controller. It is prefered not to increase the complexity of 
the control scheme at this stage to simplify the convergence 
analysis of the corresponding adaptive scheme which follows. 


Adaptive regulation 

We will assume that equation 4 holds so that the system is 
represented by equation 5 which can also be rewritten as 


Y k+1 = 6 *k + 


N, 


k+1 


where 


0 = [ B : D ] 


*k = [ U k 


Y* ] 


( 8 ) 


(8. a) 
(8. b) 


Consider the class of disturbances satisfying 

max II N(2kn+r) II s i) + p II ^ II (9) 

n^T2S2n 


The following a-priori knowledge on the plant is required 


Assumption 1 n and the upper bounds v and p in equation 9 are known 
Assumption 2 A lower bound b^ is known such that 
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b Q I * B T B 

Assumption 3 Matrices Fq > 0 and Hq > 0 defining an ellipsoid in 
the parameter space are known such that 


( 8 - e 0 ) F' 1 ( e - e 0 > T = H 0 


where 0 Q is any initial parameter estimate. The quantities and 

Hq above Eire not actually required in the computation of the 

control law but the stability and the performance of the algorithm 
will depend on them. 


The proposed adaptive scheme is now presented. The equations 
are given in the order they appear in the computation of the 
control input. 


5222 EiE£i 22 _ 2 £_thej*d§EtiYe_ 222 trol_algorittim 
Normalized variables 


vi - w <1+ll *k-i"> 

( 10a) 


(10b) 


Prediction error 


\ ~ -k " S k-l X k-l 


( 11 ) 


Least Squares with dead zone 
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(12) 


2 —T T r-2 

w k = \ \ + Vi^-iVi 


6 k = M + TJ / (l+ll^.jll) 


(13) 


X k = 


a t|w k | - 5 k ((l+a)n) 1/2 ] 

(l+x7 .F, .x, .) |w, I 

k-1 k-1 k-1 1 k 1 


If w k s 8 k ( l+a)n 


otherwise 


(14) 


a > 0 


F = F, . 
k k-1 


k k-1 k- 1 k-1 k- 

T 

1 + A, x. .F. ,x, 
k k-1 k-1 k- 


0 k 0 k-l + X k E k x k-l F k 
6 k = [ B k (nxn) , D k (nxn) ] 

Factors of F k and B k 

F k= ^ ^ 


(15) 


(16) 

(17) 


(18) 


B k = Q k S k ’ Q k Q k =I S k* 0 


(19) 


Modified parameter estimate 
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hc = 


r (nx2n) 




(nx2n) 


( 20 ) 


he = Q k he 


( 21 ) 


0 k " 0 k + he he 


( 22 ) 


0^ = [ B^tnxn), D k (nxn)] 


(23) 


Control input 


he “ <he Y k 


(24) 


The Cholesky factorization in equation 18 and the polar 
decomposition in equation 19 can be carried out for any F^O and 

any respectively. The reader is refered to Appendix B for a 

brief explanation on equation 19 and to References 29, 30 and 31 
for a more detail presentation. In fact the parameter estimate 
modification in equation 22 is only required when B^ in equation 

17 is ill-conditionned, but for sake of simplicity of notation and 
since the modification will ultimately be required for convergence 
analysis, it is decided to leave it on all the time. 


Convergence Analysis 

The convergence analysis of the adaptive control scheme 
previously discussed is now presented. The main convergence 
properties of the control scheme are given in the following 
theorem. 
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Theorem 1. Consider the system equation 2 whose disturbances 
belong to the class equation 9. Then subject to assumptions 1-3, 
the control law in equations 4 and 10 through 24 has the following 
10 properties. 

1) The plant parameter vector 0 lies inside an ellipsoid centered 
at the parameter estimate as follows 

\ K 3 H k (25) 


*0 

where 0 is the parametric distance 

0 k = 0 - 0 k (26) 
and Hj^ is given by the following expression (ref 32) 


«k = Vi + Vk 1 




1 + A. x, . F, .x, . 
k k-1 k-1 k-1 


(27) 


2) The forgetting factor A k in equation 14 satisfies the following 
inequalities 


0 s A, £ a 
k 


x, ,K .x. , 
k k-1 k-1 k-1 


(28) 


3) There exists a positive definite function V k satisfying 

v k 3 Vi (29) 

that is related to the size of the ellipsoid in equation 25 as 
follows 

V k = tr ( F k + ) (30) 
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4) The augmented error in equation 12 is bounded by 5^ in 
equation 13 as follows 

lim sup ( - 5^ (l+a)n ) ^ 0 (31) 

k-*oo 


5) The covariance matrix F k in equation 15 converges. 

6) in equation 14 is such that 

00 

£ A^5 2 is bounded 


(32) 


7) The parameter estimate vector 0^ converges end is bounded by 


0. 0* s V 2 ! 
k k o 


(33) 


where V Q is given in equation 30 for k=0. The matrices involved in 
the control law equation 24 satisfy 


8) 


b 2 I 
4V 0 


(34) 


9) 


, t , A 16V n 1 

( ) T ( B’ 1 ^ ) * ml = °_ 


(34a) 


10) If p in equation 9 is small enough that 3 e>0 such that 


1 - c 


M = 


> 0 


(35) 


[2n(l+a) ( 1+m) ] 


1/2 
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with a and m as in equations 14 and 34a respectively, then all the 
variables remain bounded and the plant output is bounded as 
follows 


lim sup { II Y k II - [2n(l+a)] 1/2 ( i) + fi )/e } ^ 0 

k-*oo 

(36) 

Each of the 10 properties previously described will now be proved 


Proof : 

1) From equation 8 it is seen that 




(37) 


where and x^_ ^ are given in equations 10a and 10b and 


% - V ,wl Vi" 


(38) 


In view of equations 9 and 13, satisfies 


T 2 

N* N, < S. 
~k ~k k 


(39) 


From equations 16 and 26 it follows 


0, =0, i - A. E. x, ,F. 
k k-1 k k k-1 k 


(40) 


From equation 15 and the matrix inversion Lemma (ref. 18) 


F k = F k-1 + X k x k-l x k-l 


(41) 


Combining equations 40 and 41 and noting that F k = F^ a 0 
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_ 1~T 

0. F. 0* 
k k k 




“ ®k-l tF k-l +X k x k-l x k-l , ®k-l“ A k®k-l 3 ^c-l^c + 


+ ^vi F kVi^ 


" 0 k-l F k-l 0 k-l + A k (0 k-l x k-r E k H ®k-l x k-l -E k ) + 


+X k E k E k ( X k x k-l F k x k-l _1 } 


From equations 11, 26 and 37 it follows 


*k-l X k-l~ E k (0 _0 k-l )x k-l _( -k _0 k-l X k-l 5 "~k 


The quadratic term x ^_i^k X k-l Can °^^ a ^ nec ^ From equation 15 as 


follows 


x k-l F k x k-l x k-l F k-l x k-l 


A k (x k-l F k-l X k-l ) 


1 + A k x k-l F k-l x k-l 


x, , F, x, , 
k-1 k k-1 


1 + A, x, , F. x. . 
k k-1 k k-1 


A, x, , F. . x. , - 1 = 
k k-1 k-1 k-1 


1 + A k x k-l F k-l x k-l 


Introducing equations 43 and 44 into equation 42 and noting that 
(see eqn. 39) 


5 s l l 


14 



gives 


B F' 1 ^- 0 F" 1 .©* = X. N. N* - 

k k k k-1 k-1 k-1 k~k _ k 




1 + X. x, ,F, * x, « 
k k-1 k-1 k-1 


*w - 




1 + X k X k-l F k-l X k-l 


= - H k _ 1 (using eqn. 27) 


(45) 


In order to prove equation 25 by induction, assume that 


,-i gT 

-1 ~k-r k-lk-1 


H..- 0,. .F,/„0* . £ 0 


(46) 


Equation 45 can also be written as 


V VrVt 1 ?* Vi F kli^-i * 0 


(47) 


Adding equations 46 and 47 results in 25. Since by Assumption 3 
equation 46 is true for k=l, the proof is complete. 


2) The two expressions in equation 28 can be readily obtained 
from equation 14. 


3) Introducing equations 15 and 27 into equation 30 and using 
equation 12 gives 




1 + X, x, . F. « x. . 
k k-1 k-1 k-1 


(48) 


In view of the way the dead zone (eqn. 14) was defined, 
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for w 2 s 5 2 (l+a)n . Study the case w 2 > S 2 (l+a)n. From equation 

48 and using equation 28 


Wi s V 5 k n - w k /(1+a) } 


S k { 5?(l+a)n - w 2 } 
(1+a) 


a[|w. |-5 Ul+a)n) 1/2 ] 

s k k { (3^ ( ( l +a ^n) 1/2- l | ) (6^( (l+a)n) + 1 | ) > 


, 1 / 2 , 


(1+a)(1+x k-i F k-i x k-i )|w k l 


a [ |w k l - 5 k ((l+a)n) 1/2 ] 2 
(1+a) ( 1 + } 


(49) 


4) Equation 49 holds for w 2 > S 2 (l+a)n, otherwise V fc = V^. 

Then V. is a positive nonincreasing sequence and therefore it 

it 

converges. Equation 31 follows from equation 49. 

5) From equation 15 it is noted that F^ s ^k -1 * Then z T F k z « 

where z is any constant vector, is a positive nonincreasing 
function and thus converges. To complete the proof it is shown 
that any element of F. can be expressed as a combination of 

k T 

quadratic terms of the form z F^ z . Define v^ as the vector of 

appropiate dimension whose elements are all zero except for the 
i-th element which is equal to 1 . Then 


F k U.J) - 


* [( V v / F k'V v j ) - v i F kV v j F k v j I/2 
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2 

6) Define t as those time instants k at which w^ > 
From equation 14 


. T _ „ “ X l-l F i-l X l-l 

A l X l-l F l-l X i-l 

1 * X I-l F i-l X l-l 


a 


i+(x i-i F i-i x i-i r ‘ 


a 


a trF 


1 + (trF ) _1 1 + tr F 

o o 


where the fact that F. , s F (eqn. 15) and x. . 

i-1 o n i-1 

was used. Introducing equation 50 into equation 48 


E v, -v, = v - v 

u k k-1 oo o 
k=l 


w 


* l \< S‘n - 


i 


i6T 


1 + 


atrF 


1 +trF 


1+trF atrF 

^ E X« ° {S^n [1+ 1 ] - w^ ] 

1ST 1 1 1 


1+trF (1+a) 
o 


1+trF 


1+trF 


atrF 


1+trF (1+a) 
o 


E Xj { «Jn[l+ 


iex 


]- 


5 j( l+a)n 


1+trF 


^(l+a)n. 


(50) 


1 (eqn. 10a) 
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1+trF o * -1 

i 0 £ ^noc ( _ ) 

1+trF ( 1+a) ieT 1+trF 

o o 

Since Aj = 0 for itfr and 5^ is bounded, it finally follows 

CO 


£Vk = EVk* V o (l+trF o (l + a))/na 
k=l 1ST 

7) Combining equations 40 and 41 produces 

®k F k “ \-l* F k-1* \ x k-l x k-l ) ' X k E k x k-l 

* ®k-l F k-l - VkVl (using eqn.43) 


or equivalently using equation 26 


e k - e - 1 v;‘- > F k 


From equation 32, £ AjS^ is a bounded, nonincreasing positive 
sequence and thus, it converges (ref. 28). Since 6 a p > 0 (eqn. 13), 


£ A^ is also bounded and thus converges too. Since the elements of 

are all bounded then £ A^N^Xj^converges. Therefore from 
the expressions above and since F^ converges, it is concluded that 
0 k converges. 
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From equation 26 

e k - 8 + < - 5 k» 

Then using equation B. 1 in Appendix B 

0 k e£ s 2( 00 T + 0 k 0 k ) (51) 

From equation 25 and some properties of positive definite matrices 
( see Appendix B ). 


(tr V IS “k 


* Vk‘ 5 k 


iv _ 1 a/ T 

£ V 1 \ln F k 1 6 k 
* Vk < trF k >" 


(52) 


On the other hand 


(trF k )(trH k ) s ([trF^trH^/2) 2 

s V 2 /4 ( using eqn. 30) 


^ V q /4 (using eqn. 29) 


(53) 


Substituting equation 53 into equation 52 gives 


0 k 0 £* IV k /4 * IV o /4 


(54) 


T 

In order to obtain a bound on 00 we recall that asssumption 3 
holds for any initial parameter estimate. Therefore equation 54 
should also hold for a 0 initial estimate and thus 

00 T sl^/4 (55) 
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Equation 33 follows after introducing equations 54 and 55 into 
equation 51. 

8) From equations 33 and 17 


T 

0 . 0 * 

k k 


1 B k ; D k 1 




b b! + D.D* s V* I 
k k k k o 


(56) 


Define 


< = V >i »" 


(57) 


Note that from equations 18, 25, 29, 30 and the above 


p, P, = 0. F. 0* 

K k^k k k k 


* «k* ItrH k 


< IV, s I V 
k o 


(58) 


Note also that (3^ in equation 57 is such that 


0 -V'Vtc 


(59) 


The expression above can be partitioned by using equations 8a, 17 
and 20 to obtain 




B= B k * W 


(60) 


Using equation B. 1 
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21 B X * 


b t b s 


*T * -T 


1 * * 1 

Vk Vic 1 

T T 

s 2[ S^S k + 1^0* B*L^ ] (using eqn 19) 

T 

£ 2[ + V q L^L* ] (using eqn. 58) 


( 61 ) 


*T , 


* * J 


In the last equation the fact that 0 k £ k and 0 k 0 k have the same 
nonzero eigenvalues was also used (see Appendix B ). Assume that 
S k = then 


S* S. = 
k k 




[ A_ S,J S,. =s [ A S, T _S,_ ] 


1 / 2 , 


max k 

[ A B*B ] 1/2 S 
max k k k 


max k k J "k 
(using eqn. 19) 


V S. 
o k 


(using eqn. 56) 


(62) 


Introducing equation 62 into equation 61 and in view of Assumption 
2 


b 0 I = B T B = 2 V o [ S k ♦ l£l (63) 

From equations 17, 20, 22 and 23 

£ k = B k + t*A r 

Introducing equations 19 and 21 into the above 
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Thus 


%c " Q k [ S k + L k ^ ] 


9) 


-k-k = [ S k + H^k ]T[ S k + ^Hc 1 (using ec l n * 19) 

a I b 2 / 4V 2 (using eqn. 63) (64) 

0 0 O'! 


< E-\) = cj( B^r 1 ^ 


s dTd.X ( B,B* ) -1 

-k~k max -k-k 


£ D. T D. [X , B.B*] -1 
-k~k min-k-k 

£ D. T D. 4V 2 / b 2 (using eqn. 64) 
-k-k o o 

(65) 


From equations 17, 20, 22 and 23 


&k= D k ♦fy-k 


Then 


D^D k £ 2 [ D k D k + L^k^kSc ] ( usin 8 eqn. B. 1) 

T T 

3 2 [ I + L^Lj. ] (using eqns.21 and 56) 


T T 

£ 2 [ V 2 + (X L* L* )(X L^L 2 ) ] I 

o max k k max k k 


T 

1 T 1 


T 

2 T 2 >2 


^ 2 [ V* + U LT LT + A Lf Lf ) /4 ] I 

o max k k max ic k 


£ 2 [ V 2 + (2 X iJl, ) 2 /4 ] I (see below) 

o max kk 
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( 66 ) 


s 4 I (using eqns. 18, 29 and 30) 
where the fact that ( see eqn. 20) 

L J L k= i i i i + i l i i 

was used. The result follows from equations 65 and 66 
10) Define the modified prediction error 


2k 


Y. - 0. .x. . 
~k k-1 k-1 


( 68 ) 


= E, - ^-i^k-l^-l ^ us ^ n S ec I ns - 11 and 22) (69) 


Therefore, using equation B. 1 

£&* aitfei 4-i^k-A-i^-A-i i (70) 

But from equations 19 and 21 


hc-l^k-l^k-lhc-l 


< 


< 


ViHUhUhU 

Vl^-lhc-l^-l (using eqn - 67) 

(using eqn. 18) (71) 


Introducing equation 71 into equation 70 and taking into account 
equation 12 we get 




2 wf 


(72) 


Using equation 8b, 10 and 23, equation 68 cam also be rewritten 
as 



1 


(73) 


^k = 


\ - 'Bk-i’Sk-l 1 

' Vl ‘ 

Y, , 

* 

b 

k-1 



1 + I^H 

Using the control law in equation 24, equation 73 reduces to 



i + „ Vl . 


Combining equations 72 and 74 

2 1 \ ~ 5 J (1+a)n ] 21 ^k-k " 2 s k (1+a)n 

Y T Y 

> k k - 25^(l+a)n 

(1+ll ^k-l l)2 

From equations 8b and 24 it follows 


"^k " 2 = IIY k n2 + l,U k " 2 

S " Y k" 2 + Y £ ( ^V SVk 

£ (1+m) IIYj^ll 2 (see eqn. 34a) 

On the other hand, using equations 8 and 9 it is seen that 


IIY k ll s (11011 + fx ) +V 

Assume that IIY^H grows unbounded. Define a subsequence t^ 

which II Y t II co and 
n 


(74) 

(75) 


(76) 

(77) 
along 
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( 78 ) 


II Y t II * max It Y i II 
n i<t 1 

n 


Then using equation 76 and the above gives 


IIY t I. 
n 

1+11 \ -i" 
n 


a l!Y t _ 1 ll / [1 + (m+l) 1/2 IIY t II ] 
n n 

a 1 / [ (m+l) 1/2 +IIY t _ i r 1 ] (79) 

n 


Introducing equations 79 and 13 into equation 75 



S 2 (l+a)n] 2 : [ (m+l) 1/2 +IIY. Jl" 1 ] -2 - 


- 2(l+a)n [ m + T?/(1+H^ t _jll ) f 

n 


(80) 


IIY^. Ilfco implies II <f>^ and II Y^ _jll-»» as can be seen from 

n n n 

equations 76 and 77. Therefore the RHS of equation 80 converges to 
(see also eqn. 35) 


( 1+m) -1 - 2(l+a)n fx 2 = 1 ~ (1 ~ e) > 0 

m+1 

Since this limit is strictly positive it contradicts the fact that 
the LHS of equation 80 satisfies equation 31. Therefore IIY^II 

should remain bounded and so should ll^ll and lliyi (see eqn. 76). 

In order to obtain an explicit bound for IIY^II consider equation 75 

again to obtain 


25 - 



2[w£-5 2 (l+ct)n] * z k [ -(2n(l+a)) 1/2 5 k +1^11/(1+11^11) ] (81) 

where 

z k = [ (2n(l+a)) 1/2 5 k + IIY k ll/( 1+110^11 ) ] (82) 

Introducing equation 13 into equation 81 gives 

2 [ w 2 - 6 2 ( l+a)n ] £ 

[ IIY k ll - (2n(l+a)) 1/2 { T) + p (l+H^.jH ) > 1 z fc / (1+110^11) 

s [||Y k ll - (2n(l+a)) 1/2 { r ) + p + > 1 z k /(1+ll ^k-l" 3 

(using eqn. 76) 


£[IIY k ll-(l-e)IIY k _ 1 ll-(2n(l+a)) 1/2 ( T) + p ) ] z fc /( 1+110^11 ) 

(using eqn. 35) 

From equations 13, 82 and the boundedness of it is clear 

that z k /(l+ll^ k _ 1 ll) is strictly positive. Therefore, from equation 
31 and the above we conclude that 

lim sup [ II Y k ll - (l-eJIlYj^ll - (2n( 1+a) ) 1/2 (t)+j i ) ] * 0 

k-*co 

The result follows. ■ 


Concluding Remarks 

This report presented an adaptive scheme that achieves 
regulation without resorting to any persistent excitation 
condition. The proposed algorithm earn be used to control minimum 
phase or nonminimum phase plants subject to bounded disturbances 
and unmodeled dynamics. 

An explicit modification for the parameter estimates was 
presented that avoids having any ill-conditionned matrix in the 
control law. This allowed the giving of explicit bounds for the 


26 



plant output. 

The proposed technique can also be used in adaptive control 
of multivariable systems whenever the estimate of a matrix 
coefficient is required to be non-si ngular. 


Appendix A 


Proof of Lemma 1 


Iterating equation la 


x(t+i) = A*x(t) + A* *bu(t) + 

+ bu(t+i-l) + 


+ A i " 1 b’v’ (t)+ 

+ b’v’ (t+i-1) 

(A. 1 ) 


for i=n 


x(t+n) = A n x(t) + SU(t) + S’V* (t) 


(A. 2) 


with , U(t) and V’ (t) as defined in Lemma 1. Premultiplying 

T 

equation A. 1 by c and using equation lb gives 


Y(t+n) = Ox(t)+GU(t)+G’V’ (t)+V"(t) 
or 


x(t) = Cf 1 [Y(t+n)-GU(t)-G’V’ (t)-V"(t) ] (A.3) 

with G,G’ , Y and V” as defined in Lemma 1. Iterating equation 
A. 2 produces 

x(t+n) = A 2n x(t-n)+A n CU(t-n)+A n C’V > (t-n)+CU(t)+C’V’ (t) (A.4) 


Substitution of equation A.4 in equation A.3 finally leads to 
equation 2 with all the variables as defined in Lemma 1 
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Appendix B 


This Appendix is intended to recall some results from matrix 
theory that are used in the report. Refer to References 29, 30 and 
31 for a more detailed analysis. 

1. - For any matrices A and B it follows that 

(A+B)(A+B) T s (A+B)(A+B) T + (A-B)(A-B) T 

s 2 ( AA T + BB T ) (B. 1) 

2. - For any positive semi-definite matrix F £ 0 it is noted that 


i) (A. F) lsFs(l F) I s (trF) I 
min max 

ii) 3 L such that F = LL T 


A F -1 = [ A , F ] 

max min 


3.- For any matrix A, A T A and AA T have no negative eigenvalues 
and have the same nonzero eigenvalues. (ref. 30 page 182) 

Sketch of the proof 

Let Aj and v^ be the eigenvalue and corresponding eigenvector 
T 

of AA , then 

AA T Vj = AjVj (B.2) 

T 

premultiplying by A 

A T A (A T v ) « Aj( A T v i ) 

Premultiplying equation B.2 by v* results in IIA T v^ll 2 = Ajllv^ll 2 . 
Then A T v i * 0 for Aj * 0 and therefore A T Vj is the eigenvector 
corresponding to the eigenvalue A^ of A T A. ■ 
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T 

4. - Any matrix A cam be expressed as A = Q S where Q Q = I and 
S^O (ref. 29 p286 ) 


Sketch of the proof 

Let and such that 


.T. 'W 2 

A A Vj = 

Vj - *u 

(B. 3) 

Then 3 , 2 j z j = such 

that 


Av i = A i z i 


(B. 4) 

Define 



Q ■ 2 z j v j * 

QVj = Zj 

(B.5) 

s = 2 Vj v j * 

Sv i “ X l v l 

(B.6) 


Then from equations B. 4 through B.6 


Av^ = *jQ v j = QSv. =* 
Furthermore, from equation B.6) S 

Q T Q = £ v zT £ z .v* = 

i j J J 


A = QS 

s 0 and from equation B.5 


References 

1 Goodwin G. C. ; Ramadge P. J. ; and Caines P.E. : Discrete-Time 
Multivariable Adaptive Control. IEEE TAC vol. AC-24, pp 
449-456, June 1980. 

2 Morse A. S. : Global Stability of Parameter Adaptive Control 
Systems. IEEE TAC vol. 25, pp 433-439, June 1980. 

3 Narendra K. S. ; and Lin Y. H. : Stable Discrete Adaptive 
Control" IEEE TAC vol. 25, pp456-461, June 1980. 


29 


4 Landau I.D. ; Lozano-Leal R. : Unification of Discrete-Time 
Explicit Model Reference Adaptive Control Designs. Automatica 
vol. 17, pp 595, 1981. 

5 Narendra K. S. ; Lin Y. H. ; and Valavani L. S. : Stable Adaptive 
Control Design, Part II : Proof of stability. IEEE TAC vol. 

25, pp 440-449, 1980. 

6 Ortega R. ; Praly L. ; and Landau I.D. : Robustness of 
Discrete-Time Direct Adaptive Ccontrollers. IEEE TAC vol. 30, 
pp 1179-1187, Dec. 1985. 

7 Ioannou P.A, ; and Tsakalis K.S. : A Robust Direct Adaptive 
Controller. IEEE TAC vol. 31, pp 1033-1043, Nov. 1986. 

8 Kreisselmeier G. ; and Anderson B.D. 0. : Robust Model Reference 
Adaptive Control. IEEE TAC vol. 31, pp 127-133, Feb. 1986. 

9 Goodwin G. C. ; Lozano-Leal R. ; Mayne D.Q. ; and Middleton R. H. : 
Rapprochement Between Continuous and Discrete Model Reference 
Adaptive Control. Automatica vol. 22, pp. 199-207, 1986. 

10 Sastry S.S. : Model Reference Adaptive Control Stability, 
Parameter Convergence and Robustness. IMAJ Contr. and Inform, 
vol. 1 pp 27-66, 1984. 

11 Astrom K. J. ; Hagander P. ; and Sternby J. : Zeros of Sampled 
Systems. Automatica vol 22, pp 199-207, 1986. 

12 Anderson B.D. 0. ; and Johnstone R. M. : Global Pole Positioning. 
IEEE TAC vol. 30, pp 11-21, Jan. 1985. 

13 Elliott H; Cristi R. ; and Das M. : Global Stability of Adaptive 
Pole Placement Algorithms. IEEE TAC vol. 30, pp 348-356, April 
1985. 

14 Goodwin G. C. ; and Teoh E. K. : Persistency of Excitation in 

Presence of Possibly Unbounded Signals: . IEEE TAC vol 30, pp 
595-597, June 1985. 

15 Kreisselmeier G. ; and Smith M.C. : Stable Adaptive Regulation 
of Arbitrary n-th Order Plants. IEEE TAC vol. 31, pp 299-305, 
April 1986. 

16 de Larminat P. : On the Stabilization Condition in Indirect 
Adaptive Control:. Automatica vol. 20, pp793-795, 1984. 

17 Lozano-Leal R. ; and Goodwin G.C. : A Globally Convergent 
Adaptive Pole Placement Algorithm Without a Persistency of 
Excitation Requirement. IEEE TAC vol 30, pp 795-797, Aug. 

1985. 


30 


18 Goodwin G. C. ; and Sin K. S. Adaptive Filtering Prediction and 
Control. Englewood Cliffs, NJ Prentice Hall, 1984. 

19 Goodwin G. C. ; Hill D. ; Mayne D.Q. ; and Middleton R. H. : 
Adaptive Robust Control (Convergence, Stability and 
Perf ormance ) . Proceedings of the 25th IEEE CDC, pp 462-467, 
Athens 1986. 

20 Narendra K. S. ; and Annaswamy A. M. : A New Adaptive Law for 

Robust Adaptation Without Persistent Excitation. IEEE TAC vol. 
32, pp 134-145, Feb. 1987. 

21 Kreisselmeier G. : Adaptive Control via Adaptive Observation 
and Asymptotic Feedback Matrix Synthesis. IEEE TAC vol. 25 pp 
717-722, Aug. 1980. 

22 Goodwin G. C. ; and Sin K.S. : Adaptive Control of Nonminimum 
Phase Systems. IEEE TAC vol. 26, pp 478-483, April 1981. 

23 de Larminat P. ; Raynaud H. F. : A Robust Solution to the 

Stabi Usability Problem in Indirect Passive Adaptive Control. 
Proceedings of the 25th IEEE CDC, pp 468-473, Athens 1986. 

24 M’ Saad M. ; Ortega R. ; and Landau I.D. : Adaptive Controllers 

for Discrete-Time Systems with Arbitrary Zeros - An Overview. 
Automatica vol. 21, pp 413-415, 1985. 

25 Bai £. W. ; and Sastry S.S. : Discrete Time Adaptive Control 
Utilizing Prior Information. IEEE vol 31, pp 779-782, Aug. 
1986. 

26 Feuer A. : A Parameterization for Model Reference Adaptive 
Pole-Placement. IEEE TAC vol 31, pp 782-785, Aug. 1986. 

27 Praly L. : Towards a Globally Stable Direct Adaptive Control 
Scheme for not Necessarily Minimum Phase Systems. IEEE Trans, 
on Automatic Control Vol AC-29, No 10, Oct 1984. 

28 Knopp K. : . Infinite Sequences and Series. New York Dover 

Publications, 1956. 

29 Gantmacher F. R. : Theory of Matrices. Chelsea Publishing Co., 
New York, 1959, Vol I. 

30 Lancaster P. ; Tismenetsky M. : The Theory of Matrices . 

Academic Press 1985. 

31 Shieh L. S. ; Lian S. R. ; and Mcinnis B. : Fast and Stable 

Algorithms for Computing the Principal Square Root of a 

Complex Matrix. IEEE Trans, on Automatic Control Vol. AC-32, 
No 9, pp 820-822, Sept. 1987. 


31 


32 Lozano L. R. ; and Ortega R. : Reformulation of the Parameter 
Identification Problem for Systems with Bounded Disturbances. 
Automat ica Vol 23, No 2, pp 247-251, March 1987. 


32 


NASA 

Naionai A^cnautcs and 
Scace Aomtoistraton 


Report Documentation Page 


1. Report No. 

NASA TM- 1005 71 

2. Government Accession No. 

4. Title and Subtitle 

Robust Adaptive Regulation 

Without Persistent Excitation 

7. Author(s) 


Rogelio Lozano-Leal* 



9. Performing Organization Name and Address 

NASA Langley Research Center 
Hampton, VA 23665-5225 


12. Sponsoring Agency Name and Address 

National Aeronautics and Space Administration 
Washington, DC 20546-0001 

15. Supplementary Notes 


3. Recipient's Catalog No. 


5. Report Date 

May 1988 

6. Performing Organization Code 


8. Performing Organization Report No. 


10. Work Unit No. 

506-46-11-01 

11. Contract or Grant No. 


13. Type of Report and Period Covered 

Technical Memorandum 

14. Sponsoring A9&ncy Code 


* National Research Council Associate 


16. Abstract 


This paper presents a globally convergent adaptive regulator for minimum or 
nonminimum phase systems subject to bounded disturbances and unmodeled 
dynamics. The control strategy is designed for a particular input-output 
representation obtained from the state space representation of the system. 
The leading coefficient of the new representation is the product of the 
observability and controllability matrices of the system. The controller 
scheme uses a Least Squares identification algorithm with a dead zone. The 
dead zone is chosen to obtain convergence properties on the estimates and 
on the "covariance matrix" as well. This allows the definition of modified 
estimates which secure well-conditioned matrices in the adaptive control 
law. Explicit bounds on the plant output are given. 


NASA FORM 1626 OCT 86 FOR SALE BY THE NATIONAL TECHNICAL INFORMATION SERVICE, 
SPRINGFIELD, VA 22161-2171 


18. Distribution Statement 

Unclassified-Unlimited 
Subject Category 63 

is page) 21. No. of pages 22. Price 

33 A0 3 


17. Key Words {Suggested by Author(s)) 

Adaptive Control, Identification, 

Linear Systems 

20. Security Classif. (of tl 
Unclassified 


19. Security Classif. (of this report) 
Unclassified 




















